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PATTERN AVOIDANCE IS NOT P-RECURSIVE 


SCOTT GARRABRANT* AND IGOR PAK* 


Abstract. Let .F C Sj; be a finite set of permutations and let Cn(J^) denote the number of per¬ 
mutations a £ Sn avoiding the set of patterns if. The Noonan-Zeilberger conjecture states that the 
sequence {Cn{T)} is P-recursive. We disprove this conjecture. 

The proof uses Computability Theory and builds on our earlier work IGPII . We also give two 
applications of our approach to complexity of computing {Cn(iF)}- 


1. Introduction 

Combinatorial sequences have been studied for centuries, with results ranging from minute properties of 
individual sequences to broad results on large classes of sequences. Even just listing the tools and ideas 
can be exhausting, which range from algebraic to bijective, to probabilistic and number theoretic |Rio| . 
The existing technology is so strong, it is rare for an open problem to remain unresolved for more than 
a few years, which makes the surviving conjectures all the more interesting and exciting. 

The celebrated Noonan-Zeilberger Conjecture is one such open problem. It is in the area of pattern 
avoidance which has been very popular in the past few decades, see e.g. |B6na[ iKlt] . The problem was 
first raised as a question by Gessel in 1990, see |Gesl §10]. In 1996, it was upgraded to a conjecture 
and further investigated by Noonan and Zeilberger |NZ| . see also >110.111 There are now hundreds of 
papers in the area with positive results for special sets of patterns, all in support of the conjecture, 
and only two recent experimental clouds against it (see >110. 4|l . Here we disprove the conjecture. 

Let a € Sn and uj € Sk- Permutation a is said to contain the pattern uj if there is a subset 
X C {1,... ,n}, |A| = k, such that a\x has the same relative order as oj. Otherwise, tr is said to 
avoid UJ. Fix a set of patterns X C Sk- Denote by CniX) the number of permutations a € Sn avoiding 
the patterns uj ^ T. The sequence {C'„(J^)} is the main object in the area, extensively analyzed from 
analytic, asymptotic and combinatorial points of view (see >110. 1|) . 

An integer sequence {on} is called polynomially recursive, or P-recursive, if it satisfies a nontrivial 
linear recurrence relation of the form 

qo{n)an + gi(n)a„_i -|- ... + qk{n)an-k = 0, 

for some qi{x) G Z[a;], 0 < i < k. The study of P-recursive sequences plays a major role in modern 
Enumerative and Asymptotic Combinatorics (see e.g. [FSlIOdniSti^ L They have D-finite (also called 
holonomic) generating series and various asymptotic properties (see >110.21) . 

Conjecture 1.1 (Noonan-Zeilberger). Let X C Sk be a fixed set of patterns. Then the sequence 
{Cn(,X)} is P-recursive. 

The following is the main result of the paper. 

Theorem 1.2. The Noonan-Zeilberger conjecture is false. More precisely, there exists a set of patterns 
T C Sso, such that the sequence {CniX)} is not P-recursive. 

We should mention that in contrast with most literature in the area which studies small sets of 
patterns, our set X is enormously large and we make no effort to decrease its size (cf. >110.61) . To 
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be precise, we construct two large sets T , T ' C Sso and show that at least one of them gives a 
counterexample to the conjecture. In fact, it is conceivable that a single permutation pattern w = (1324) 
may be sufficient (see ill0.4l) . 

The proof of Theorem 11.21 is based on the following idea. Roughly, we show that every two-stack 
automaton M can be emulated by a finite set of permutation patterns. More precisely, we show that 
the number of accepted paths of M is equal to Cn{J') mod 2, for a subset of integers n forming an 
arithmetic progression (see Main Lemma 1^ . This highly technical construction occupies much of 
the paper. The rest of the proof is based on our approach in [GPI], where we resolved Kontsevich’s 
problem on the P-recursiveness of certain numbers of words in linear groups. The ability to emulate 
any two-stack automaton M in the weak sense described above is surprisingly powerful (see below). 

Let us now present two applications of our results to the complexity of computing Two 

sets of patterns J-i and are called Wilf-equivalent, denoted J^i ~ J^ 2 , if C'ra(-^i) = C'n(-^ 2 ) for all n. 
In |V2| . Vatter asked whether it is decidable when two patterns are Wilf-equivalent. Here we resolve 
a mod-2 version of this problem (cf. Section |5] and 1110.101) . 

Theorem 1.3. The problem whether Cn{iFi) = Cn{iF2) mod 2 for all n G N, is undecidable. 

For the second application, we say that an integer sequence {a„} has a Wilfian formula, if it can be 
computed in time polynomial in n. This notion was introduced by Wilf in a different context [M3- 
Recently, both Klazar |Kla| and Vatter |V2| asked whether every sequence {Cn{iF)} has a Wilfian 
formula. 

Theorem 1.4. If EXP 0EXP, then there exists a finite set of patterns T, such that the sequence 
{C'n(J^)} cannot be computed in time polynomial in n. 

This also seems to give a good answer to Wilf’s original question “Can one describe a reasonable and 
natural family of combinatorial enumeration problems for which there is provably no polynomial-in-n 
time formula or algorithm to compute f{n) ?” |Wilf| (see also H10.9|) . 

Here EXP is the complexity class of problems decidable in exponential time, and ©EXP is the 
exponential time analogue of the ©P, so EXP C ©EXP C EXPSPACE. We refer to Section [5] for the 
definitions, details and references. It is believed that EXP ^ ©EXP (see il9.1l) . so the answer to the 
question by Klazar and Vatter is likely negative (cf. 1110. 81) . 

The rest of the paper is structured as follows. We begin with an explicit construction of a two-stack 
automata with a non-P-recursive number of accepted paths (Section [5]) . In Section [3J we reduce the 
proof of Theorem 1 1.2 1 to the Main Lemma l3.2l on embedding two-stack automata into pattern avoidance 
problems. The proof of the Main Lemma spans the next four sections. We first present the construction 
in Section H) In Section [SJ we prove the lemma modulo a number of technical results. We illustrate 
the construction in a lengthy example in Section [6l and prove the technical results in Section m We 
proceed to prove theorems II.31 and II.41 in sections |8] and [U respectively. We conclude with final remarks 
and open problems in Section [TUI 


2. Two-stack automata 

In this section we construct an automaton with a non-P-recursive number of accepted paths. The 
construction is technical, but elementary. Although it is more natural if the reader is familiar with 
basic Automata Theory (see e.g. |HMTT1[SIF| ), the construction is completely self-contained and is given 
in the language of elementary Graph Theory. The proof, however, is not self-contained and follows a 
similar proof in |GP1| . 

To be precise, we give an explicit construction of a graph, where the vertices have certain variables 
as weights. We then count the number a„ of paths of length n between two fixed vertices, where 
only certain weight sequences are allowed (we call these balanced paths). The non-P-recursiveness of 
a„ mod 2 is explained below. 
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2.1. The motivation. It is relatively easy to present a construction of an automaton which produces 
a non-P-recursive sequence {a„} of balanced paths. Our goal in this section is stronger - the sequence 
{a„} we get is not equal to any P-recursive sequence modulo 2. Somewhat informally, we call such 
automaton non-P-recursive. The advantages afforded by the modulo 2 property are technical and will 
become clear later in this paper. 

Our main tool for building a non-P-recursive two-stack automaton is the following result. 

Theorem 2.1 l |OPll Lemma 2]). Let {a„} be a P-recursive integer sequence. Consider an infinite 
binary word a = (0102 ...), defined by Un '■= On mod 2. Then, there exists a finite binary word which 
is not a subword of a. 

What follows is a construction of a two-stack automaton such that the corresponding binary se¬ 
quence a contains every finite binary subword by design. There are many such automata, in fact. We 
give a complete description of this one as we need both its notation and additional properties of the 
construction later on. 

2.2. The setup. Let P be a finite directed graph with vertices vi,... ,Vm. Let X denote the set of 
labels of the form Xi and let X~^ denote the set of labels of the form x~^, where i is any integer. 
Define Y and similarly. Label each vertex of P with an element of X U X~^ U T U Y~^ U {e}. 

Let p{v) denote the label on vertex v. We say that Wi ^ W 2 if Wi,W 2 € X U X~^ or if Wi,W 2 S 
Y UY~^. If P has an edge from Vi to Vj, we say that Vi —>■ Vj. 

Contrary to standard notation, we refer to a path 7 = 71 ... 7 „, where each 7 ^ is a vertex, not an 
edge, and we say that such a path is of length n, even though it only has n — 1 edges. 

We further require that p{vi) = p{v 2 ) = s, and that there is no edge Vi —>■ Vj, with p{vi) ^ p{vj). A 
graph P satisfying all of the above conditions is called a two-stack automaton. 

As we traverse a path 7 , we keep track of two words wx G X* and wy € Y*, which start out empty. 
Whenever we enter a vertex with label Xj, we append Xi to the end of wx- When we enter a vertex 
with label x~^, we remove Xi from the end of wx- We modify wy similarly when entering vertices with 
label yi or y~^. When we enter a vertex with label £, we do nothing. A path is called balanced if every 
step of this process is well defined and both wx and wy are empty at the end of the path. Let G'(r, n) 
denote the number of balanced paths in P from vi to V 2 of length n. 

Define an involution n.y S S'„ as follows. If the above process writes an instance of a label to wx 
or Wy at some time t^, and removes the same instance of that label for the first time at time tj, then 
TT(ti) = tj and TT(tj) = ti. If the process does not write or remove anything at a time step tk, then 
7 r(t/c) = tk. For example, if p( 7 i)p( 72 )... ^( 79 ) = exiyixiyf^xf^exf^e, then ir-f = (2 8)(3 5)(4 6 ). 
This gives the following alternate characterization of balanced paths. 

Proposition 2 . 2 . A path 7 is balanced if and only if there exists an involution tt-,, G Sn such that: 

(1) / 9 ( 7 i) = £ for all -Kj{i) = i , 

(2) / 9 ( 7 i) G XUY and /o( 7 ^.,(i)) = phi)~^, for all Tr-f{i) > i, and 

(3) There are no i and j with p{'ji) ~ p( 7 j) such that i < j < TTj{i) < 717 (j). 

Further, this involution is uniquely defined for each balanced 7 . 

The proof is straightforward. 

2.3. Non-P-recursive automaton. We are now ready to present a construction of such automa¬ 
ton Pi, which is given in Figure [T] The construction is based on a smaller automaton P 2 we introduced 
in [GPI]. 


Lemma 2.3. There exists a two-stack automaton Fi, such that cxn '■= G(Pi,n) G {0,1} for all n, and 
such that the word a = (0102 • ■ •) is an infinite binary word which contains every finite binary word 
as a subword. 

Proof. We give an explicit automaton Pi in Figure I. This automaton is formed by modifying the 
automaton P 2 , given in [GP1| . Here we use £!,...,£§ to denote the same trivial label £; we make this 
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Figure 1. The automata Fi (left), and r 2 (right). 


distinction only for the purpose of illustration. The vertex vi is the shaded vertex labelled ei, and 
the vertex V 2 is the shaded vertex labelled es- The vertex labelled in Ti corresponds to the vertex 
labelled Si in r 2 . 

The primary difference between Ti and r 2 is that Ti has labels on vertices while r 2 has labels on 
edges. The labels were also changed by replacing Oa,, lx, and x with xq, xi, and X 2 respectively, and 
similarly for y. Since the lengths of the paths change slightly, we get a slightly different formula, but 
the analysis is similar. 

In counting paths we follow the proof of Lemma 3 in EEU. The valid paths through T 2 have 

k 

fj, = j + Qk + 2Y^ [log 2 ij edges, 

i=l 

for some positive integers j and k such that the j-th binary digit of fc is a 1. Every path through Ti 
will similarly have (/i + 1 ) vertices with label e. 

Such paths will also have a total of 4fc vertices labelled X 2 , , 1/2 or , since k copies each of X 2 

and ?/2 are written and removed in the computation. Similarly, every binary integer from 1 to fc is 
written and removed from both tapes, so the vertices with the remaining 8 labels are used 

k 

v = Ak + A Llog 2 times in total. 

i=l 

In summary, we have G'(ri, n) = 1 for all n = (/x + 1) + 1 / + Ak, where j and k are positive integers 
such that the j-th binary digit of fc is a 1, and G'(ri, n) = 0 otherwise. The word a = {aia 2 ■ ■ ■) then 
contains the positive integer k written out in binary starting at location 

k 

n = 2 + 14fc + 6 Llog 2 *J ) 

i=l 

and will therefore contain every finite binary word as a subword. 

Finally, note that in the notion of “valid path” from |GP1| . it was possible for some instance of x~^ 
to cancel with a later instance of x. For our purposes, this difference is irrelevant since the words 
defined by paths in r 2 do not have such cancellations. □ 
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3. Main Lemma and the proof of Theorem 11.21 

In this section we first change our setting from pattern avoidance to slightly more general but 
equivalent notion of partial pattern avoidance. We state the Main Lemma 13.21 and show that it implies 
Theorem 11.21 

3.1. Partial patterns. A 0-1 matrix is called a partial pattern if every row and column contains at 
most one 1. Clearly, every permutation pattern is also a partial pattern. We say that a permutation 
matrix M contains a partial pattern L, if L can be obtained from M by deleting some rows and 
columns; we say that M avoids L otherwise. Given a set T of partial patterns, let Cn{d^) denote the 
set of n X n matrices M which avoid all partial patterns in if. By analogy with the usual permutation 
patterns, let Cn{F) = |C„(J^)|. 

Proposition 3.1. Let T\ be a finite set of partial patterns. Then there exists a finite set of the usual 
permutation patterns Ti, such that Cn{^i) = Cn{J^ 2 ) for all n S N. 

Proof. First, let us prove the result for a single partial pattern. Let L be a partial pattern of size p x q, 
and let fc = p - 1 - q. Denote by Vn{L) be the set of n x n permutation matrices containing L. Let 
us show by induction that for all n > k, every permutation matrix M S VniL) contains a matrix 
in Vk{L). Indeed, the claim is trivially true for n = k. For larger n, observe that every n x n 
permutation matrix M which contains L must also contain some i-th row and j-th column, such that 
Mp q = 1, and neither i-th row nor j-th column intersect L. This follows from the fact that otherwise 
rank(M) < i + j < n. Deleting these row and column gives a smaller permutation matrix which 
contains L, proving the induction claim. 

We conclude that J^ 2 {L) := Lie<kVe{L) is the desired set of matrices for if = {L}. In full generality, 
take T 2 = ULgjF.A 2 (L). The details are straightforward. □ 

It therefore suffices to disprove the Noonan-Zeilberger Conjecture [O] for partial patterns. 

Lemma 3.2 (Main Lemma). Let T be a two-stack automaton. Then there exist sets T and T' of 
partial patterns, and some integers c,d> 1, such that 

Ccn+d(J^) - Ccn-ediJ^') = G(T,n) mod 2, for all n € N. 

The proof of the Main Lemma is given in Section [5l 

3.2. Proof of Theorem 11.21 By Lemma 12.31 there exists a two-stack automaton Fi, such that the 
infinite binary word a = (0102 ...) given by = G(ri,n), contains every finite binary word as a 
subword. By Lemma [3.21 there exist integers c and d and two sets T and F' of partial patterns such 
that Ccn+d{F) - Ccn+d{F') = G(Fi,n) mod 2, for all n. 

If Conjecture 11.11 is true, then both {Cn{Ff} and {G„(J^')} are P-recursive sequences. Since P- 
recursive sequences are closed under taking the differences and subsequences with indices in arithmetic 
progressions (see e.g. (sti §6.4]), this means that the sequence {a„}, defined as a„ = {Ccn+d{J^) — 
Ccn+di^')}) is also P-recursive. On the other hand, from above, we have a„ = a„ mod 2. This gives 
a contradiction with Theorem nn 

The second part of the theorem requires a quantitative form of the Main Lemma and is given as 
Corollary 14.41 □ 


4. The construction of an automaton in the Main Lemma 

4.1. Notation. The construction of sets of matrices F,F' has two layers and is quite involved, so we 
try to simplify it by choosing a clear notation. We use Ag to denote a certain subset of q x q matrices, 
which we call an alphabet and use as building blocks. We use English capitals with various decorations, 
notably A, A', B, B', E, L, P, Q, R, S, Tk and Zp, to denote 0-1 matrices of size at most g x g. We use 
script capital letters Fi, Fi, Wi, W', to denote the sets of larger matrices (partial patterns) which form 
sets F,F'. Each is of size at most 8q x 8q, and some of the matrices are denoted Wi and W/. 
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On a bigger scale, we use M = M{*, *) to denote large block matrices, with individual blocks M®’-! 
being either zero or matrices in the alphabet Ag. For the proof of Theorem 11.21 we take g = 10, but 
for theorems II.31 and II.41 we need larger g. When writing matrices, we use a dot (•) within a matrix to 
represent a single 0 entry, and a circle (o) to represent a g x g submatrix of zeros. 


4.2. The alphabet. A permutation matrix is called simple if it contains no permutation matrix as a 
proper submatrix consisting of consecutive rows and columns, other than the trivial 1 x 1 permutation 
matrix. 

Define an alphabet Ag of all 5 x 3 simple permutation matrices which contain the following matrix 
as a submatrix: 


L = 


/■ 


... 1 
1 . . . 


1 ■ ■ 

■ 1 ■ 
V- • 1 


■/ 


Proposition 4.1. We have: \Ag\ 9^-1^ as g ^ 00 . 

Proof. It was shown in |AAK| that the probability that a random g x g permutation matrix M is 
simple tends to 1/e^ as 5 —>• 00 (see also [OEISI Allllll]). On the other hand, the probability that 
M avoids L tends to 0 as g —>■ 00 . Thus, the probability that M € Ag tends to 1/e^, as desired. □ 

By the proposition, we can fix an integer g large enough that \Ag\ > 5 + m + r, where m is the 
number of vertices in T and r is the number of distinct labels in A U T on vertices of T. 

We build our forbidden partial patterns out of elements of Ag as follows. Choose five special matrices 
P, Q, B, B', E e Ag, as well as two classes of matrices, Ti,..., Tm S Ag, and Zi,...,Zr € Ag. Here 
the matrices Ti,... ,Tm represent the m vertices in T. Let Ti denote the matrix corresponding to vt. 
The matrices Zi,... ,Zr represent the r labels in XUY. Let s{Zp) denote the label which corresponds 
to Zp. Let us emphasize that these choices are arbitrary as the only important properties of these 
(5 + m + r) matrices is that they are all in Ag and distinct. 


4.3. Forbidden matrices. Let Ei denote the set of all g x {g + 1) or {g + 1) x g partial patterns 
formed by taking a matrix A in Ag, and inserting a row or column of all zeros somewhere in the middle 
of A. 

Let E 2 denote the set of all {2g + 1) x (bg + 1) or [bg + 1) x {2g + 1) partial patterns whose bottom 
left g X g consecutive submatrix is a i? or B' and whose top right g x g consecutive submatrix is Tj 
for some j. 

Let A 3 denote the four element set consisting of the {2g + 1) x t; and g x {2g + 1) partial pattern 
formed by inserting g + 1 rows of zeros below Q, inserting g + 1 rows of zeros above P, inserting g + 1 
columns of zeros to the right of Q, or inserting g + \ columns of zeros to the left of P. 

Let A 4 = Wi U W 2 U Wa U >V 4 U W 5 , where Wi are defined as follows. Let Wi, W 2 and W 3 denote 
the sets of matrices of the form Wi, W 2 and IT 3 , respectively: 


Wi 


f O o Ti 
000 
Loo 


o B' 
o o 


o Ti 


o o Tk o 
0000 
R o o o 


W2 = 


o o o Ti 
0000 
o L o o 
Zp 000 
0000 
o o B' o 


o o Ti 


o o Tk 

000 


o R o o / 


W 3 = 


/ O O Ti o o o 
00 o o o Tj 
L o 0000 
00 o E o o 
00 0000 
o B' o o o o 
\ o o o o B O 



In all three cases, we require L,R€ {B,B'} and Vi -T vj -T Vk- In Wi, we require p{vj) = s{Zp). In 
W 2 , we require p(vj) = (s(Zp))~^. In W 3 , we require p(vj) = e. 
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Similarly, let Wi and W 5 denote the set of all matrices of the form W 4 and W 5 respectively: 


W4. = 


/ O O o o Ti o \ 
o _P o o o o 

o o i 5 o o o 

o o o o o Tfc 

B' o o o o o 

o o o _R o o 


Ws = 


( o o Ti o o o\ 

00 o o o Ti 

L o 0000 
00 o E o o 

00 o o Q o 

\o B' o 00 0 / 


Here, in W 4 , we require R G and vi —>■ Vk, and in W 5 , we require L G {B,B'} and Vi -T V 2 - 

Finally, let E 5 denote the set of all patterns of the form 

/ o Zp o \ / o Zp o \ / o o Tj \ 

{ o o Zq \ , I o o Zq \ Or { Zp o o , whero s(Zp) ^ s(Z„). 

\B O O J \B' O O J \ O Zq O J 


Lemma 4.2 (Explicit Construction). Given a two-stack automaton F, let 

T := T\ U T 2 U Tz U T 4 U J-^ and T' \= T V} {B, B '}, 
where iFi,..., B, B' are defined as above. Then, for all n, we have: 

Cm{B) — Cm{B') = ^(r,?!,) mod 2, where m = (3n + 2)g. 

The Main Lemma 15^ follows immediately from this result. 

4.4. Counting Partial Patterns. We will now analyze the above construction in the specific case 
of Fi. 


Theorem 4.3. There exists a set T of at most 6854 partial patterns of size at most 80 x 80 such that 
{Cn{iF)'\ is not P-recursive. 

Converting these partial patterns into the usual permutation patterns would require many more 
patterns. However all the patterns avoided would still be size at most 80 x 80. 


Corollary 4.4. There exists a set T of 80 x 80 permutation matrices such that the sequence {C„(J^)} 
is not P-recursive. In particular, |J^| < 80! < 10^^®. 


Proof of Theorem \4.3\ Observe that Fi has 31 vertices and uses 6 labels in X UY. Therefore we need 
5 + 31 + 6 = 42 matrices in Ag. Let g = 10. Consider the following simple 9x9 pattern 


L' = 



1 


1 


1 



Note that there are 60 ways to insert 1 into L' to form a simple 10 x 10 pattern. Indeed, the 1 may 
inserted anywhere other than the 4 corners or the 36 locations that would form a 2 x 2 consecutive 
submatrix. All 60 of these 10 x 10 are distinct and in Ag. 

For Fi, we actually only need to include the 42 matrices in Aio which are actually used, so |J^i| = 
42 • 9 • 2 = 756. Similarly, for ^ 2 , there are 2 choices for the bottom left 10 x 10 consecutive submatrix 
and 31 choices for the top right 10 x 10 consecutive submatrix. There are 41 entries in the middle and 
at most one of them can be a 1, which can be satisfied in 42 ways. Therefore, |J^ 2 | = 2 - 31 - 2 - 42 = 5208. 
Clearly, \Fz\=Y 

Let us show that |J7i| = 292. Indeed, a matrix in Wi uyV 2 UWa is defined by the path Vi Vj -T Vk 
and the choices for L and R. There are 71 paths in F of length 3, so we have |yViUW 2 U>V 3 | = 71-4 = 284. 
A matrix in W 4 is defined by the vertex Vk and the choices for R, so we have IW 4 I = 4. Similarly, a 
matrix in W 5 is defined by the vertex Vi and the choices for L, so IW 5 I = 4. 

Finally, for F 5 , there are 6 choices for Zp, 3 choices for Zg and 31 + 2 choices for the B, B' or Tj. 
Therefore, = 6 • 3 • 33 = 594. In total, F consists of |J^| = 756 + 5208 + 4 + 292 + 594 = 6854 
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partial patterns of dimensions at most 80 x 80. The set T' has two extra matrices, but can be made 
smaller than T since avoiding B' makes all matrices G J -4 redundant. □ 


5. Proof of the Explicit Construction Lemma 

In this section we give a proof of Lemma 14.21 bv reducing it to three technical lemmas which are proved 
in Section[71 Briefly, since T C T', we have Cn{T') C Cn{T) for all n. Denote = Cn{T') \ Cn{T). 
We construct an explicit involution (/> on and analyze the set of fixed points We show that the 
set T>'^ has a very rigid structure emulating the working of a given two-stack automaton L. 


5.1. Preliminaries. The key idea of an involution 0 defined below is a switch B GG B' between 
submatrices B and B', in such a way that the fixed points of (p avoid B'. The remaining copies 
of B create a general diagonal structure of the matrices in and enforce the location of all other 
submatrices from the alphabet. We invite the reader to consult the example in the next section to 
have a visual understanding of our approach. 

We also need a convenient notion of a marked submatrix. Such marked submatrix will always be 
a B, and is located at a specific position in forbidden matrices Wi- This is best illustrated in the matrix 
formulas below, where marked submatrix B is boxed. 

Let jF'^ = >V( U W 2 U W 3 U >V 4 U W 5 , where W' C Wi are defined to have no submatrices B' (so 
L = R = B in the notation above), and where the elements of W 4 have a unique marked submatrix B. 
Precisely, let >V(, and W 3 denote the set of matrices of the form W 2 and W 3 , respectively: 


Wl = 


B 

o 

o 


B 


Ti 


o Ti 


o 

o 

o 

B 


O Zr) 


° Tk 


VP' = 


o B 


B 


O Zp 
Ti o 




o Ti 

o 


3 ^ 
o o 


o o 
o Tk 


o 

B 


( 

o 

B 

,W^= ° 


O / 


B 


Ti 


O O T 

o o 
E o 


J ^ 
o o 
o o 

° Tk 


B 


Similarly, let W 4 , and denote the set of matrices of the form W 4 and IT 5 , respectively: 


/ 


Wi = 


o o o Ti 
o o 


\ 


/ 


0 

0 E 

0 

0 

0 

11 

B 

0 

0 

0 

0 

0 

0 

0 0 

0 

0 

Tk 

0 

0 

0 

E 

0 

0 

B 

0 0 

0 

0 

0 


0 

0 

0 

0 

Q 

0 

0 

0 0 

B 

0 

0 / 


\ ° 

B 

0 

0 

0 

° / 


T 

o 


A 


Of course, all these IT/ satisfy the same conditions as Wi in the previous section. 


5.2. Construction of the involution p. From this point on, let m = (3n -I- 2)g. Given a m x m 
permutation matrix M, let refer to the g x g submatrix in rows g{i — 1 ) -I- 1 through gi, and 
columns g{j — 1) -|- 1 through gj. 

First, observe that := Cm(3^) \ Cm{3^') is the set of all m x m matrices avoiding B with at least 
one submatrix B or B'. Since Bn avoids Bi, every submatrix B or B' in a matrix in must be a 
consecutive g x g block. A submatrix B or B' in a matrix M of is called blocked if replacing it with 
B' OT B, respectively, would result in a matrix not in 

Lemma 5.1. Consider the map p on Bn which takes the leftmost unblocked submatrix B or B' and 
replaces it with B' or B respectively. The map (p is an involution on Bn . Furthermore, the fixed points 
of (j) are the m x m matrices M such that: 

(1) matrix M avoids B, 

(2) matrix M avoids B', 

(3) matrix B is a submatrix of M, and 

(4) every submatrix B inside M is a marked submatrix of a matrix in B 4 . 
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Let = Fix((/)) denote the set of all fixed points of (j). Since (f) is an involution, we conclude that 
\'Dn\ = \'D'^\ mod 2, so it suffices to show that \'D'J\ — G{T,n) mod 2. 

5.3. The structure of Let 7 be a path from vi to V 2 which is not necessarily balanced, and let 
TT g Sn- Denote by M := M('y, tt) the m x m permutation matrix given by: 

(1) = p, 

(2) M3"+1’3"+1 = 

(3) M3*+2-3i-2 = p for all 

(4) M3*-2.3i+2 = Tj for all i, where 7 * = Vj, 

(5) = p whenever p(ji) = e and 7 r(f) = j, 

(6) = Zp whenever p{'yi) = s{Zp) and 7r(i) = j, 

(7) = Zp whenever pl'ji) = {s{Zp))~^ and 7 r(i) = j, 

( 8 ) = 0 is a zero matrix otherwise. 

Lemma 5.2. Every matrix in T)'^ is of the form M( 7 , 7 r), where j is a path of length n in L, and 
TT e Sn - 

Note, however, not every matrix is in 'D'^. The following lemma gives a complete charac¬ 

terization. Recall that given a balanced path 7 , there is a unique permutation tTj associated with 7 
given in Proposition 12.21 

Lemma 5.3. Let 7 6 e a path in T of length n, and let tt G S'„. Then, M( 7 , 7 r) S if and only if "f 
is balanced and tt = . 

Lemmas 15.1115.21 and 15.31 easily imply the Main Lemma. 

5.4. Proof of Lemma 14.21 We have Cm{d') — = |Dn| by definition. Lemma l5.ll shows 

that (p is an involution, so \T>n\ = |Fix((/))| = \T>'^\ mod 2. Combining lemmas 15.21 and 15.31 we get 
\D'^\ = G{T,n). Thus, Gcn+di^^) - Gcn+d{^') = G{T,n) mod 2, as desired. □ 

6. Example 

Let us illustrate the construction in a simple case. Consider a two-stack automaton Fa given in Figure 2. 
Note that Fa has a unique balanced path 7 = viV 3 V^v^vqV 4 V 2 V 4 V 2 - 


vi V3 ve Vi V2 



V5 


Figure 2. The two-stack automaton Fa. 

Let us show that the following matrix M = M{'-f,TT-y) is unique in the set of fixed points Vg. Here 
in the matrix, we have s{Zi) = Xi and s{Z 2 ) = yi (see below). 

As in the definition of M{'y, Wj), observe that M has a diagonal of E entries below the main diagonal, 
and a diagonal of entries above the main diagonal. The Ti entries give the vertices of the path 7 , in 
order. Observe that M also has a P in the top left and Q in the bottom right, as in the definition of 

We have here the involution tt.^ = (2 8 ) (3 5) (4 6 ), and the locations of the E, Z^ and Z 2 matrices 
form the permutation matrix for 7 r.y. Each matrix E corresponds to a time when the path 7 visited a 
vertex labelled e. Similarly, each Zp above the diagonal corresponds to a pair of times when a given 
instance of a label was written and removed from one of the stacks. 
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The red and blue squares in M connect each Zp with the corresponding times along 7 that the label 
was written and removed. Red represents X, while blue represents Y, as defined in Section [2] Notice 
that when two of these squares cross (marked black), it means that the first label written was also 
the first label removed. This can only happen when the two labels are written on different stacks, so 
squares of the same color cannot cross. 

The matrix M avoids X 2 , since the only copes of P and Q are near the top left and bottom right 
corner. Similarly, matrix M avoids since no Ti is too far up and to the right of any B. Clearly, M 
avoids B', so M avoids T 4 . 

Now recall the matrix L in the definition of the alphabet Ag'. 


L = 


/■ 


V- • 1 


Observe that M avoids Pi , since there is no submatrix where each 1 comes from a different g x g block. 
Finally, the fact that M avoids T 5 corresponds to the fact that the lines coming out of Zp and Zg never 
cross when Zp ^ Zg. 

Clearly, matrix M contains B and avoids B'. One can verify that every submatrix R in M is a 
marked submatrix in some matrix P 4 . Since M satisfies all of the conditions of Lemma l5.11 we conclude 
that M G V'^. 


7. Proofs of technical lemmas 

7.1. Proof of Lemma 15.11 First, let us show that every matrix M which satisfies the following 
properties, is a fixed point of cj) : 

(1) matrix M avoids P, 

(2) matrix M avoids B', 

(3) matrix R is a submatrix of M, and 
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(4) every submatrix in M is a marked submatrix in some matrix 

Observe that (1) and (3) imply that M avoids T but not T' = T {B, B'}. Therefore, we have 
M € Vn- Further, (2) and (4) imply that M is a fixed point of </), since M has no B', and replacing 
any B with a B' will create a matrix in J^ 4 . 

Next, we show that every matrix in which violates the above criteria is fixed by (jy^ but not 
by (j). Observe that a matrix M G T>n which satisfies (2) also satisfies (1) and (3). Consider now a 
matrix M G Vn which violates either (2) or (4). Clearly, we have (j>{M) G Vn- It suffices to show 
that ^ M and that (jP{M) = M. 

Let TV be a matrix in Denote by Al a submatrix B or B' in N. Let N' be the matrix formed by 
replacing A with B' or B, respectively. Similarly, let A' denote this submatrix B or B' in N'. 

Assume that N' did not avoid Fi. Then there would exist a submatrix S G Ag of N' which is not 
a consecutive g x g block. Note that S must intersect A'. Consider the submatrix S fl A'. This must 
be a permutation matrix, since B and A' are permutation matrices. Furthermore, 5" C A' must be a 
consecutive submatrix of 5", since A' is a consecutive submatrix of N'. Since S is simple, we have 
that S' n A' is a single 1 entry. This entry might be a 0 in N, but it does not matter because we could 
replace it with another 1 entry from A, to form a non-consecutive submatrix S in N. Thus, N does 
not avoid J^i, contradicting the assumption that N G T>n. 

Since N' avoids Fi, any instance of a matrix from F 2 , F^, or F^ intersecting A' in N' must contain A' 
or intersect A' in a single row or column. In either case, replacing A with A' gives another matrix 
in F 2 , F 3 , or F 5 , contradicting the fact that N' avoids F 2 , F^ and F^. 

Therefore, if the submatrix A is blocked it must be because A' is contained in a matrix in JTj. 
Since F/^ is closed under replacing any B with a S', it must be that A = B and A' = B'. Any matrix 
which violates (2) therefore contains a instance of S', which is necessarily unblocked, and so is not 
fixed by cj). For matrices in which satisfy (2), containing an unblocked instance of B is equivalent 
to violating (4). Therefore, any matrix which violates (4) is not fixed by so ^ M. 

Let r]{N) denote the leftmost unblocked instance of B or B' in N, and let A = g{N). Observe 
that A' is also clearly unblocked in N'. Assume that A' ^ g{N'). There must be another unblocked 
instance S' of i? or B', which is further to the left than A'. However, S would also be unblocked in N, 
contradicting the assumption that A = g{N). Therefore, A' = t]{N'), which implies that = N. 

We conclude that = M for all M. 

In summary, every matrix M satisfying (1) through (4) is fixed by (j), and every matrix in not 
satisfying (1) through (4) is fixed by (jA but not (j). Therefore, map 4> is an involution whose fixed 
points are exactly the matrices satisfying (1) through (4). □ 


7.2. Proof of Lemma I5.2L Let M be a matrix in Lemma EH] shows that 


( 1 ) 

( 2 ) 

(3) 

(4) 


matrix M avoids F, 
matrix M avoids B', 
matrix H is a submatrix of M, and 

every instance of i? in M is the marked submatrix in some matrix in F[. 


B 


. Therefore, for every 


Observe that every matrix in F'^ has a H or a P above the marked submatrix 
instance of B in M, there must be another B or a P somewhere above it. Since there is at least one B 
in M, there must be at least one P in M. This P must have at least g rows above it and g columns to 
the left, since it is contained in some matrix in W^. Note that matrix P cannot have any more rows 
above it or columns to the left, since M avoids F 3 . Therefore, is the unique instance of P in M. 
Similar analysis shows that jVfSn+i.Sn+i -g unique instance of Q in M. 

Similarly, every matrix in F^ has a Tj at least 4g rows above and 4g columns to the right of the 


B 


Since M avoids P 2 , there can be no more rows or columns inserted in between this B and Tj. Therefore, 
for every instance of B in M, there must be some Tj exactly Ag rows above and Ag columns to the 
right. In particular, this means that if = B, then = Tj for some j. 

The Ti above the P must be Ag rows above and Ag columns to the right of the B to the left of the P. 
This is only possible if this B is in location , and the Ti is in location . 
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If = B and i ^ n, then there must another instance of B exactly 3g columns to the right, and 
some Tfe exactly g rows above, since every matrix in yV[, W 3 or has this pattern. We know 
that these submatrices cannot be further away because they are squeezed between the B and the Tj . 
The new must be Ag rows below and Ag columns to the right of the new instance of B. This can 
only be achieved by letting = B and = Tk- 

Thus, the instances of i? in a matrix M in D'^ are exactly the matrices jVf 3 z+ 2 , 3 z- 2 ^ for 1 < z < n. 
Similarly, we have ^ 3 »- 2 . 3 i +2 _ some j. Let 7 i denote the vertex in T corresponding to the 

matrix 7VL3z-2,3i+2_ restrictions in about adjacent Vi ensure that 7 = 71 ... 7 ra is a path from 
Vi to V2- 

When we specify this path 7 , we uniquely define all of the submatrices except for those of the 
form Further, the restrictions from tell us that each is either a matrix of zeros or 

equal to E or Zp. If the matrix at location is nonzero, then it is uniquely determined by the 

restrictions from J 7 on the rows of M. 

Let TT be the permutation such that 7r(i) is the unique j, such that is E or Zp. Let us prove 

that M = M( 7 , 7 r). We already showed that = P, j\^ 3 ra+i, 3 ra+i _ j^3i+2,3i-2 _ ^ 

all i. We know that = Tj where 7 ^ = Vj, by the definition of 7 . 

By definition, submatrix is non-zero if and only if 7 r(z) = j. The restrictions on E and Zp 

from Ti imply that = E for ^( 7 ,) = e, = Zp for p{j,) = s{Zp), and = Zp for 

Pili) = i.s{Zp))~^. We have a total of m entries I's, so all remaining M®’-! are zeros matrices. This 
implies that M = M( 7 , 7 r). □ 


7.3. Proof of the only if part of Lemma 15.31 First, we show that if M( 7 , 7 r) G then 7 is 
balanced and tt = ttj. By Proposition 12.21 it suffices to show that the permutation tt satisfies the 
following four properties: 

(1) p(ji) = e for all 7 r(z) = i , 

(2) p( 7 j) gXVJY and ^( 777 ( 1 )) = for all 7 r(z) > z, 

(3) there are no i and j with p(pii) p(nj) such that i < j < 7r(i) < 7 r(j), and 

(4) permutation tt is an involution. 


Proof of (1): Consider the case where 7 r(z) = i. The submatrix is non-zero then. In this case, 

the B at must be the marked submatrix B in some instance of a matrix in W 3 , W 4 or W^. 


Thus, M^®’^® = E and M^® ^ = Tj, where pi'fi) = p{vj) = e, so tt satisfies (I). 

Proof of (2): Consider the case where 7 r(z) > i, so is non-zero. In this case, the submatrix B at 

M3®+2"3*-2 niust be B in some instance of a matrix in >V{. Thus, M^®’^’®^®) = Zp, and = Tj, 


where pi'ji) = p{vj) = s{Zp). Similarly, the submatrix B at M^''®(®^+^’^®®*^®)“^ must be a marked 
submatrix in some matrix in W^- Thus, jVf 37 r(i)- 2 , 3 ir(i)-i -2 _ where p{'^Tr{i)) = p{vk) = {s(Zp))~'^. 
We conclude that p{'^i) G X LiY and ^( 7 , 7 ( 7 ) = p{li)~^, so tt satisfies (2). Similar analysis shows that 
if 7 r(z) < i, then p( 7 ^(j)) G X UY and pi'fi) = ^( 7 , 7 ( 1 ))“^, so 7 r“^ satisfies (2) as well. 


Proof of (3): Assume that there exist i and j with p{"fi) ~ p(7j) such that i < j < 7r(z) < 7r(j). Let 
s{Zp) = p{fi) and s{Zq) = p{fj). We then have M^®’^®®^®^ = Zp and = Zq. Observe that 

jff 3 j+ 2 , 3 j -2 _ Since 3z < 3j < 3j -I- 2 and 3j — 2 < 37r(z) < 37r(j), these three matrices together 
form a pattern which is in a contradiction. This implies that tt satisfies (3). Similar analysis shows 
that there are no i and j with pi'fi) 7 ^ pilj)-, such that 7r(z) < 7r(j) < i < j, so 7r“^ satisfies (3) as well. 


Proof of (4): Note that the conditions on tt only mention values i for which 7r(z) > i. Therefore, even 
if TT were not an involution, the permutation tt would have to agree with at all i such that 7r(z) > i, 
by the uniqueness of the involution 7 r.y. However, a similar analysis shows that 7 r“^ must also satisfy 
conditions (1), (2) and (3), so 7 r“^ also agrees with tTj at all i such that 7 r“^(z) > i. Combining these 
two observations, we conclude that tt = tt~^ = tt.^. □ 
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7.4. Proof of the if part of Lemma l5.3l It remains to prove that tTj) € Clearly, matrix B 
is a submatrix of In addition, matrix M( 7 , 7 r.y) has exactly n submatrices B, and each of 


them is the marked submatrix 


B 


in some matrix in 


Recall that there is a unique P and Q in and they are sufficiently close to the edge to 

ensure that M ( 7 , avoids J-^- Similarly, we know the locations of all submatrices B and T^, and they 
ensure that M ( 7 , tTj) avoids ^ 3 . Clearly, matrix M ( 7 , tTj) avoids B', and therefore also avoids P 4 . Also, 
if M( 7 , TTj) did not avoid J 7 , this would contradict the fact that there are no i and j with p(ji) ~ p( 7 j) 
such that i < j < TT^{i) < 

Finally, we need to show that M{'-f,TTy) avoids Jq. Assume that does not avoid Jq, and 

that A is ‘A g X g submatrix of M{'y,TT^), such that A € Ag and A is not a consecutive g x g block 
in M{'y,TTy). Since A is simple, every 1 in A comes from a different block M'^’f By definition of Ag, 
matrix L is a submatrix of A (see Ul\i . Assume the 1 in the center of L is above or on the main 
diagonal of M. It must therefore be in an E, Tj, or Zp. The top three I’s in L must be in matrices of 
the form Zg^ since there is not enough room for any of them to be in a T^. 

Since the relation partitions the set of ZpA into two equivalence classes, two of these I’s must 
be in some Zp and Zq with Zp Zq. However, there is a submatrix B that is below and to the left of 
both Zp and Zq. Together they form a matrix in contradicting the fact that M( 7 , tt-^) was shown 
above to avoid Jq. Similar analysis gives a contradiction if the 1 in the center of L is below the main 
diagonal. 

We conclude that M ( 7 , tTj) satisfies all four conditions from Lemma lOl This implies M ( 7 , iVy) G T>'„, 
as desired. □ 


8. Decidibility 

8.1. Simulating Turing Machines. It is well known and easy to see that two-stack automata can 
simulate (nondeterministic) Turing machines. This simulation works by using the two-stacks to rep¬ 
resent the tape of the Turing machine (see e.g. [HMU] 1. To recap, let one stack contain everything 
written on the tape to the left of the head, while the other stack contains everything written to the 
right. Moving the head of the Turing machine left or right corresponds to removing a symbol from one 
stack and writing a (possibly different) symbol on the other stack. This simulation is direct and can 
be done in polynomial time. We refer to [HMUl |Sip| for the definitions and details. 

8.2. Proof of Theorem 11.31 Let M be an arbitrary deterministic Turing machine, with no input. 
Consider the two-stack automaton which simulates M. If M does not halt, G'(r, n) = 0 for all n. If M 
eventually halts, then T will have a single balanced path, and G'(r, n) = 1 for some n. 

Construct the F and F' associated with this T as in Lemma l3^ By analogy, we then have Cn{iF) = 
Cn{P') mod 2 for all n = d mod c if and only if M does not halt. Recall also that the halting problem 
is undecidable (see e.g. |Sip| ). 

Therefore, by the argument above, the construction in the proof of Lemma 13.21 can be emulated by 
a Turing machine, and the construction satisfies Cn{F) = Cn{J-') mod 2 for all n d mod c. Thus, 
given M, we can construct finite sets T and T' permutation patterns, such that Cn{P) = Cn{J-') for 
all n > 1 if and only if M does not halt. Therefore, it is undecidable whether Cn{J-) = Cn{P') for all 
n> 1. □ 

8.3. Implications. Theorem 11.31 has rather interesting implications for our understanding of pattern 
avoidance (cf. HIO.IOI) . For example, a standard argument (see e.g. [Poonl p. 2]), gives the following 
surprising result: 

Corollary 8.1. There exist two finite sets of patterns T and T' , such that the problem of whether 
Cn{P) = Cn{iF') mod2 for all n € N, is independent of ZFC. 

We would be curious to see an explicit bound on the size of such sets of patterns, but it is likely to 
be quite large. Here is another immediate application of the theorem: 











14 


SCOTT GARRABRANT AND IGOR PAK 


Corollary 8.2. For all k large enough, there exist two finite sets of patterns T and T', such that the 
smallest n for which mod 2 , satisfies n > A(n). 

Here A(n) is the Ackermann function (see e.g. [AF]), but any other computable function can be 
used in its place. 

8.4. Speculations. These results give us confidence in the following open prolems, further extending 
Theorem 11.31 

Conjecture 8.3 (Parity problem). The problem of whether Cn{iF) = 0 mod 2 for all n S N, is un- 
decidable. 

We believe that our tools will prove useful to establish this conjecture, likely with a great deal more 
effort. This goes beyond the scope of the paper. 

Conjecture 8.4 (Wilf-equivalence problem). The problem of whether C'„(J^i) = Cn{J^ 2 ) for all n €N 
is undeeidable. 

This conjecture is partly motivated by the recently found unusual examples of Wilf-equivalence |BP| . 
It is more speculative than Conjecture 18.31 since in our construction Cni^) — grows rather 

rapidly. It is thus conceivable that in contrast with Corollary 18.21 the smallest n for which Cn{iF) 7 ^ 
Cn{d-') is constructible, perhaps even quite small in the size of the patterns. This would imply that the 
mod-2 problem is computationally harder than the Wilf-equivalence problem, a surprising conclusion. 

In a different direction, it would be also very interesting to resolve the parity and the Wilf-equivalence 
problems when only one permutation is avoided. In this case, we believe that both are likely to be 
decidable. 

Conjecture 8.5. For forbidden sets with a single permutation |J^| = \iF'\ = 1, both the parity and the 
Wilf-equivalence problems are deeidable. 

In order to clarify and contrast the conjectures, let us note that non-P-recursiveness is quite possible 
and rather likely for permutation class avoiding one or two permutations (see 1 110.41) . However, the 
undecidability is a much stronger condition and we do not believe one permutation has enough room 
to embed all logical axioms. This “small size is hard to achieve” phenomenon is somewhat similar to 
aperiodicity and undecidability for plane tilings (see 1110.71) . 

9 . WiLFIAN FORMULAS 

9.1. Complexity preliminaries. Recall the ©P complexity class which is a parity version of the 
class of counting problem ffP, see e.g. |Pap| . For example, ©2SAT and the parity of the number of 
Hamiltonian cycles are ©P-complete, see |Val| . It is strongly believed that ®P P. In fact, if P = ®P, 
then PH = BPP by Toda’s theorem. In particular, this implies NP = BPP, contradicting widely held 
beliefs that P = BPP and P NP. 

Recall the exponential complexity classes EXP, NEXP and its counting counterpart ^EXP. Let us 
now formally define an exponential time version of ®P. A language D is in ®EXP if there exists a 
nondeterministic Turing machine M such that M has an odd number of accepting paths on input n 
if and only if n S P, and every path in M halts in time 0(2^*^^^) where p is a polynomial, and ^ 
is the length of the input in bits. For example, computing parity of the number of non-isomorphic 
Hamiltonian graphs on n vertices is in ®EXP, see [OEISl A003216]. Similarly, for a fixed F, computing 
Cn{F) mod 2 is in ®EXP by definition (cf. 110.91) . 

Now, it is believed that EXP ^ ®EXP for reasons similar to P 7 ^ ®P. First, note that P = ®P 
implies EXP = ®EXP, see e.g. [BBF| . In the opposite direction, it follows from the proof of the main 
result in (Hisl, that EXP = ®EXP implies that there are no polynomially sparse languages in ®P\P 
(see |Pap| for definitions). This is an unlikely conclusion given how far apart P and ®P are0 For more 
discussion of ®EXP in relation to other complexity classes, see [BBF] (see also ^10.Sp . 

^This argument and further evidence against EXP = 0EXP was communicated to us by Joshua Grochow on CS Theory 
Stack Exchange: http://tinyurl.coin/m79o4dv 
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9.2. Proof of Theorem 11.41 Let D be a language in 0 EXP. There exists a nondeterministic Turing 
machine M and a polynomial p such that M has an odd number of accepted paths on input n if and 
only a n £ D, and every path in M halts in time at most on input n. 

Let us form M' modifying M, by artificially extending every accepted path in such a way that it 
instead accepts at exactly time [2^ + nj for some p' > p. We further assume that p' is increasing, 

so + nJ is injective on N. Therefore, all accepted paths of M' of length [2^ + n\ must 

come from input n. 

Let us form M" by modifying M' in such a way that instead of taking an input n, it nondetermin- 
istically chooses a natural number n. The number of accepted paths of length [2^ (i°sn) _|_ .^^ill still 
be odd if and only \i n & D. We can now build a two-stack automaton L which simulates M” so that 
C?(r, [2^ (log") -I- nJ) is equal to the number of accepted paths in M of length 12P d° 8 ") _|_ 

Finally, we construct the sets of patterns T and associated with this F, following the construction 
in Lemma [3.21 We have then: 

G(r, [2P"P°S") + nJ) = mod 2, 

where m = c[2p d° 8 ") + nJ + d. This implies that n € D ii and only if Cm{d') — Cm{^') is odd. 

Assume now that J- and T have a Wilfian formula. Then we can compute Cm{T) — and 

thus decide if n € I? in time polynomial in m. Clearly, time polynomial in m is time exponential 
in (logn). This implies that EXP = 0EXP, a contradiction. □ 


10. Final remarks and open problems 

10.1. Despite a large literature on pattern avoidance, relatively little is known about general sets of 
patterns. Notably, the Stanley-Wilf conjecture proved by Marcus and Tardos shows that Cn{^) are at 
most exponential |MTj . improving on an earlier near-exponential bound by Alon and Friedgut |AF| . 
Most recently, Fox showed that for a fixed k and a random permutation uj G Sk, we have Cn{J^) = 
exp(fc®(^)n) |Fox| (see also |V3l §2.5]). 

10.2. For an integer P-recursive sequence {a„}, the generating series A{t) = J2'^=o is D-finite 

iholonomic), i.e. satisfies a linear ODE (see e.g. fFSlISte^ L In the case a„ = the series Ait) is 

also a G-function, an important notion in Analytic Number Theory (see e.g. [Sir]). 

10.3. The most celebrated example of Wilf-equivalence is (123) ~ (213). It follows from results of 

MacMahon (1915) and Knuth (1973), that C'„(123) = C'n(213) = the n-th Catalan number, 

see e.g. [EtlEti]. Many other Wilf-equivalent classes are known now, see e.g. m- 

10.4. There are three Wilf-equivalence classes of patterns in S^. Two of them are known to give 
P-recursive sequences, but whether {Cn,(1324)} is P-recursive remains a long-standing open problem 
in the area (see e.g. [Sti|V3]). The problem proved so challenging, Zeilberger himself seems to have 
abandoned Coniecture 11.11 because of it, see m- 

We should mention that there seems to be some recent strong experimental evidence against sequence 
{(7„(1324)} being P-recursive. Numerical analysis of the values for n < 36 given in |CG) suggest the 
asymptotic behavior 

C„(1324) - A • A”" • , 

where A 8 , A ~ 11.6, p ss 0.04, and a ~ —1.1. If this asymptotics holds, this would imply non-P- 
recursiveness by Theorem 7 in |GPI| . which forbids terms. 

For larger sets, the leading candidates for non-P-recursiveness are the sequences {C'„(4231,4123)} 
and {C'n(4123,4231,4312)1 which were recently computed for n < 1000 and 5000, respectively [EB- 
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10.5. There is a bit of a controversy over a question whether the integer N := (71000(1324) is humanly 
or supernaturally computable, with Steingrimsson and Zeilberger occupying the opposite sides of the 
argument, see lEVlISti] . From a formal Theoretical CS point of view, this is really an argument over 
the existence of a Wilfian formula to compute {(7„(1324)} (cf. |MR| ]. This raises a curious question 
whether computing {(7„(1324) mod 2} is in EXP, which is perhaps easier to resolve. Leaving aside 
philosophical and theological issues, the proof of Theorem 11.41 suggests a surprising possibility that 
even the parity of N might be hard to compute. 

Note also that (7„(1324) = 14,(1324) mod2, where 14(w) is the number of involutions a G Sn 
avoiding oj. The sequence {14(1324)} is still difficult to analyze (see |BHPV| 1. It is known to have a 
much smaller growth, so perhaps easier to compute. 

10.6. The bound |J^| < 10^^® in Corollary 14.41 can easily be improved down to a bit under 30,000 by 
refining the proof of Theorem 14.31 and using small technical tricks. While it is possible that a single 
permutation suffices (see above), it is unlikely that the tools from this paper can be used. 

10.7. It is worth comparing the non-P-recursiveness of pattern avoidance with the history of aperiodic 
tilings in the plane. Originally conjectured by Wang to be impossible |Wang| , such tilings were first 
constructed by Berger in 1966 by an undecidability argument |Ber) . Note that Berger’s construction 
used about 20,000 tiles. In 1971, by a different undecidability argument, Robinson was able to reduce 
this number to six |R5b| . Most recently, Ollinger established the current record of five polyomino 
tiles m- Without undecidability, Penrose famously used only two tiles to construct aperiodic tilings 
(see e.g. |GS| 1. Whether there exists one tile which forces aperiodicity remains open. This is the 
so-called einstein problem (cf. |ST| and |Yang[ §7.5]). See also [Boas! IGIi IP1| for the complexity of 
several other related general tiling problems. 

10.8. Note that we do not claim that computing the parity of Cn{F) is 0EXP-complete. This is 
because our argument would have J- and J-' as an input, which is tangential to the Klazar-Vatter 
question in the introduction. Still, it would be interesting to prove the following complexity variation 
on Theorem ll.4l 

Conjecture 10.1. There exists a finite set of patterns T, such that computing {(7„(J^)} is ffEXP- 
complete, and computing {(7„(J^) mod 2} is (BE.XP- complete. 

To give an example of a ©EXP-complete problem, one can take a parity version of a known ffEXP- 
complete problem in cases where the reduction is parsimonious. For example, the parity of i times 
the number of 3-colorings in succinct graphs |GW| is a natural candidate (see [Bar] for a parsimonious 
reduction) 0 Perhaps the closest in spirit to the conjecture are the N EXP-complete tiling problems 
considered in ED, where the input is a single integer n, rather than a set of tiles (cf. |BHiillPT| L 

10.9. Wilfian formulas were introduced by Wilf in 1982, see IMS- They have been christened and 
received some attention only very recently |V2[ IZei) 0 We believe this is the first paper which examines 
them from the computational complexity point of view. Of course, pattern avoidance itself is a special 
case of the pattern matching problem, with a large algorithmic and complexity literature. See e.g. (GM] 
for the recent breakthrough and imti §8.2.1] for further references. 

We should mention that all P-recursive sequences trivially have Wilfian formulas, but the opposite 
is false. For example, the sequence of primes is not P-recursive jFGSj . but the n-th prime is clearly 
computable in exponential time. Same with the number p(n) of partitions of n. The asymptotics 
p{n) ~ C ■n~^ ■ implies that it is not P-recursive (see above), but Euler’s recurrence (see e.g. |P2| 1. 
shows it is computable in time polynomial in n. 

A quick warning to the reader. Just because the sequence {a„} grows exponentially and has no 
known o(a„) time algorithm to compute it, does not mean that {a„ mod 2} is also hard. Typical 

^This approach was suggested to us by Greg Kuperberg on CS Theory Stack Exchange: http://tinyurl.com/m79o4dv 
^In the original paper IWilf| . Wilf uses two notions of a formula which led to some confusion in the definitions. In 
particular, Klazar in IkH uses a more restrictive notion which is equivalent to the one we use for exponentially growing 
sequences. 
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examples mentioned in the literature are the number of self-avoiding paths [Zei] (see also [HeM 
A001411]), and the number of unlabeled graphs on n vertices |Wilf) (see also [OEISl A000088]). In 
both cases, the sequences are even for n large enough (the first is obvious, the second is proved in |CRp . 

10.10. In [EV| . Zeilberger asks to characterize pattern avoiding permutation classes (of single permu¬ 
tations) with g.f.’s rational, algebraic, or D-finite. We believe a complete characterization of the latter 
class is impossible. 

Open Problem 10.2. The problem of whether {Cni^f} is P-recursive is undecidable. 

Let us note that our results offer only a weak evidence in favor of the open problem, since Theorem l2.ll 
gives only a necessary condition on P-recursiveness, and (cf. EEI]). It would be interesting to see if 
any of Zeilberger’s problems are decidable. A rare decidability result in this direction is given in |BRV) 
(see also a discussion in |V3[ §3]). 

10.11. The original form of the Noonan-Zeilberger Conjecture makes a stronger claim: for every 

!F = {uji,... ,u}g} and an integer vector r = (ri, ... ,rg) € N^, the sequence {Cn{J^, r)} is P-recursive, 
where Cn{iF,r) is the number of permutations a G Sn which contain exactly copies of pattern Wi, 
for all 1 < * < £. It was shown by Atkinson in 1999, that this stronger claim is equivalent to the 
ri = ... = = 0 case, which is our Conjecture 11.11 see |Atk| . 

Other variations on the Noonan-Zeilberger Conjecture have also been studied in the literature, 
including the case of consecutive patterns |Eli| . set partitions (Sail , and patterns with infinite support 
(see |V3| 1. Theorem 11.21 can perhaps be further extended to show that for some set T the g.f. for 
{C'n(J^)} is not ADE (see e.g. [Sta| l. We plan to explore this problem in [GP3| . 

10.12. Some basic ideas in this paper have been first developed in a much easier case of Wang tilings 
of the square, studied in |CP2| (see also [Kitl §9.8 .2]). Curiously, a key tool is Theorem 12.11 which we 
proved in |CP1| by a short self-contained argument. Note that this lemma is used in |CP1| also to 
prove the non-P-recursiveness of the probabilities of returns in linear groups, but is applied in a very 
different way. 
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